The Multimodal Listening Test in a High-Stakes Context: Gender-Neutral or not?

In this study, we used the Rasch measurement to investigate fairness of listening section a national computerized high-stakes English test for differential item functioning (DIF) across gender subgroups. The format inspired us whether items measure comprehension differently females and males. Exploring novel task types including multimodal materials such as videos pictures was especially interesting. Firstly, unidimensionality local independence data were examined preconditions DIF analysis. Secondly, authors explored performance female male students through analysis using measurement. uniform showed that 25 (out 30 items) displayed favored different subgroups, whereas effect size not meaningful. non-uniform revealed several exhibiting with moderate large size, favoring various ability groups. Explanations are hypothesized. Finally, implications study regarding development discussed.